Test

polynomialExpansion - Databricks window.settings = {"enableAutoCompleteAsYouType":[],"devTierName":"Community Edition","workspaceFeaturedLinks":[{"linkURI":"https://docs.cloud.databricks.com/docs/latest/databricks_guide/index.html","displayName":"Databricks Guide","icon":"question"},{"linkURI":"https://docs.cloud.databricks.com/docs/latest/sample_applications/index.html","displayName":"Application... [Read More]

Insert records in pandas dataframe

Initialize an empty record (np.NaN) Insert the empty record into exist DataFrame according to DataFrame’s index Within the DataFrame, Fill np.NaN with previous record (method=’ffill’) Notes: Before fill in missing value with method forwar fill, the dataframe should be sorted first. import pandas... [Read More]

Sparkml Pipeline

from pyspark.ml import Pipeline from pyspark.ml.classification import LogisticRegression from pyspark.ml.evaluation import BinaryClassificationEvaluator from pyspark.ml.feature import HashingTF, Tokenizer, IDF from pyspark.ml.tuning import CrossValidator,... [Read More]

markdown language

basic usage of markdown language

Here is a 5 minutes markdown tutorial - it’ll teach you how to transform regular text into bold/italics/headings/tables/etc. Here is some bold text Here is a secondary heading Here’s a useless table: Number Next number Previous number ... [Read More]